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DIAGNOSTIC SYSTEM AND METHOD FOR PHONOLOGICAL 
AWARF.NESS. PHONOI .OGTCAL PROCESSING. AND READING SKILL TESTIN G 

Related Application 

This application is a continuation-in-part application of US patent application serial 
number 09/350,791, filed July 9, 1999, entitled "Diagnostic System and Method for 
Phonological Awareness, Phonological Processing, and Reading Skill Testing" and owned by the 
same assignee as the present invention. 

Appendix 

This disclosure includes and incorporates Appendix A which is attached. Appendix A is 
24 pages and discloses details of the data graphing and reporting functionality of the diagnostic 
system and method for phonological awareness, phonological processing and reading skill 
testing. 

Background of the Invention 

This invention relates generally to a diagnostic system and method for testing one or 
more different areas of phonological awareness, phonological processing, verbal short term 
memory, rapid access naming, phonemic decoding and reading fluency in order to determine if 
the individual being tested is at risk to having reading problems and the areas in which the 
individual may need further training. 

It is well known that a relationship exists between phonological processing abilities of an 
individual and the normal acquisition of beginning reading skills. For inefficient and disabled 
readers, the reading impasse exists in the perceptual and conceptual elusiveness of phonemes. 
Phonemes are the smallest units of speech that correspond to the sounds of our spoken language. 
Our phonologically based language requires that students have a sensitivity to and an explicit 
understanding of the phonological structure of words. This explicit understanding of the 
phonological structure of words is known as phonological awareness. Phonological awareness 
skills are displayed by an individual when the individual is able to isolate and identify individual 
sounds within words and to manipulate those identified sounds. Phonological processing refers 
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to the use of information about the sound structure of oral language to process oral and written 
information. These include verbal short term memory and rapid access naming. 

The English language has words that are comprised of sounds in some predetermined 
order. From the vast number of possible sequences of sounds, words in the English language 
actually use a relatively small number of sequences and the majority of these sequences are 
common to many words. A child who becomes aware of these common sound sequences is 
typically more adept at mastering these sequences when the words are presented in their printed 
form (i.e., when the child is reading the words) than a child who lacks this awareness of sounds. 
For example, the word "mat" has three distinct, phonemes /m/, /ae/ and /t/ The words "sat" and 
"bat" have different initial phonemes, /s/ and Ibl respectively, but share the middle and final 
phonemes (/ae/ and /t/, respectively) that form the common spelling pattern "at". To a child with 
normal phonological awareness, our alphabetic orthography appears to be a sensible system for 
representing speech in writing. Thus, a child may employ the strategy of sounding out unknown 
words or letter sequences by analogy to known words with identical letter sequences. For 
example, the child may pronounce the unknown word "bat" by rhyming it with the known word 
"cat". 

Phonological awareness skills are grouped into two categories including synthesis and 
analysis. Phonological synthesis refers to the awareness that separate sound units may be 
blended together to form whole words. Phonological analysis refers to the awareness that whole 
words may be segmented into a set of sound units, including syllables, onset-rimes and 
phonemes. Both analysis and synthesis skills have been identified as important prerequisites for 
achieving the goal of early reading skill proficiency and deficits of either and/or both of these 
skills are typically present in children. with reading disabilities. 

In addition to these phonological awareness skills, there are two other phonological skills 
that have been linked to efficient reading ability. These skills are phonetic coding in verbal short 
term memory and rapid, automatic access to phonological information. Phonetic coding refers to 
the child's ability to use a speech-sound representation system for efficient storage of verbal 
information in working memory. The ability to efficiently use phonetic codes to represent verbal 
information in working memory may be measured by performance on memory span tasks for 
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items with verbal labels. Children with reading problems have been found to perform poorly on 
memory span tasks for items with verbal labels. Thus, phonetic coding is an important skill for a 
reader, such as a beginning reader. For a beginning reader, he/she must 1) first decode each 
sound in the pattern by voicing the appropriate sound for the appropriate symbol; 2) store the 
appropriate sounds in short term memory while the remainder of the symbols are being sounded 
out; and 3) blend all of the sounds from memory together to form a word. The efficient phonetic 
representation in verbal short term memory permits beginning readers to devote less cognitive 
energy to the storage of sound symbol correspondence thus leaving adequate cognitive resources 
to blend the sounds together to form the word. 

The strong performance of a child on rapid naming skills that requires rapid and 
automatic access to phonological information that is stored in long term memory is highly 
predictive on how well a child will.learn fluent word identification skills. A reading-disabled 
child may normally perform much more slowly on these rapid naming tasks than a child with a 
normal reading skill. The rapid access of phonological information in memory may make the 
task of assembling word parts together much easier so that reading is easier. 

In addition to assessing phonological processing skills that do not require knowledge of 
print, three other measures of pre-reading and reading skills prove helpful in monitoring a child's 
growth once reading instruction begins. In particular, the child's knowledge about letters, the 
child's phonemic decoding skill and the child's fluency of reading should be monitored during 
the first three grades in order to identify the need for early intervention that will prevent reading 
problems later on. It is desirable to be able to test these pre-reading and reading skills in order to 
further determine if a child is at risk. 

Returning to the relationship between phonological processing and reading, an individual 
with good phonological processing skills and good phonological awareness tends to be better 
able to learn to read. In addition, phonological processing deficits have been identified by 
researchers as the most probable cause of reading-related learning disabilities. Due to this link, 
many states have started to mandate phonological awareness training as part of regular classroom 
reading curricula. At the same time, school personnel are being required to be accountable and 
take responsibility for the classroom curriculum and the remedial reading services they provide. 
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The problem is that there is no diagnostic tool currently available to help professionals and the 
school personnel to identify children who are at-risk due to phonological awareness deficit and to 
help plan, evaluate and document the effectiveness of intervention and instructional methods. 

A number of assessment tools are presently available to professionals to measure 
phonological processing and related skills. These include the Test of Phonological Awareness 
(TOP A), the Lindamood Auditory Conceptualization Test (LAC), The Phonological Awareness 
Test (PAT), the Comprehensive Test of Phonological Testing (CTOPP) and a screening measure 
published in an educational textbook, Phonemic Awareness in Young Children: A Classroom 
Curriculum. None of these conventional assessment tools are software based and therefore have 
3o limitations. For example, these conventional assessment tools must be manually administered so 
" 3 that the testing is not necessarily standardized since each test giver may give the test in a slightly 
different manner that reduces the reliability of the resulting assessment. These manually 
administered assessment tools also make the scoring, charting and comparison of the test results 
more difficult. These conventional assessment tests require that a skilled person administrate the 
05 assessment test. In addition, the number of children who may be tested at any one time is limited 
to one child for each test administrator. These conventional assessment tests may also cause test 
±1 anxiety that may cause the test results to inaccurately reflect the child's abilities. Thus, it is 
H 1 desirable to provide a diagnostic system and method for phonological awareness testing that 

overcomes the above problems and limitations of conventional assessment tests and it is to this 
20 end that the present invention is directed. 

Summary of the Invention 

The diagnostic system and method for evaluating phonological awareness and processing 
skills and related pre-reading and reading skills in accordance with the invention provides a 
system for identifying individuals, such as children in kindergarten through second grade, who 
25 are likely to experience academic failure due to phonological processing deficits and a lack of 
phonological awareness. The system may also determine the relative weaknesses and strengths 
of the individual or group of individuals in different phonological awareness and processing 
areas or related reading skills in order to help develop appropriate intervention and curriculum 
activities to improve the weak skills and areas. The system may also track, over time, an 
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individual's development or a group's development of various phonological awareness and 
processing skills and relating reading skills and establish a baseline so that the effectiveness of 
instructional methods may be evaluated. The system may identify individual with weak 
phonological awareness and processing skills and correct those skills before the individual 
5 develops a reading problem. In a preferred embodiment, the diagnostic tool may be one or more 
software applications being executed on a Web server so that the diagnostic tool may be an 
Internet or World Wide Web (the Web) based tool that provides an easily accessible and 
affordable screening tool to help parents determine, in the comfort of their own home, if their 
child is at-risk for academic failure due to phonological awareness and processing deficits. The 
Jg 0 system may also suggest solutions (training modules that train a particular phonological 
*S awareness, phonological processing skill or a related reading or pre-reading skill) for a parent to 
jfy consider in correcting the phonological awareness and processing deficits. 

rQ In more detail, the diagnostic system in accordance with a preferred embodiment of the 

[~ invention may include one or more software applications that may be stored on a portable media, 
Qs such as a CD or a zip disk or may be stored on a server. The diagnostic system provides various 
fy advantages over conventional diagnostic tools. The system permits more standardized 
£ administration of the tests that leads to more reliable assessments. The system also permits more 
H* efficient, accurate and reliable scoring and tracking of an individual's phonological awareness 
and processing abilities so that the individual's progress may be determined by comparing the 
20 various test results to one another and comparing the results of tests given at different time to 
each other. The system may be administered by people who do not necessarily understand the 
intricacies of phonological awareness and processing skills. In addition, the system may be 
administered simultaneously to a large number of individuals since each children may use a 
separate computer to complete the tests. Finally, the engaging graphical game format of the tests 
25 within the diagnostic system may reduce an individual's test anxiety so that a more accurate test 
may be conducted. 

The diagnostic system may include one or more interactive computer activities that 
permit the diagnostic system to measure one or more different types of phonological awareness 
and processing skills, knowledge of sound-symbol correspondences and fluency of decoding and 
30 reading. The system in accordance with the invention may also collect risk factor and other 
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relevant data about each individual, assess performance on activities that measure phonological 
awareness and processing skill, analyze risk factor data and performance data for individuals or 
groups of individuals, and report those results. In a preferred embodiment, the system may be 
used for diagnosing phonological awareness and processing skill deficits in a young child. 

Thus, in accordance with the invention, a system and method for testing one or more 
skills associated with the reading skills of an individual is provided. The method comprises 
presenting one or more stimuli to the individual, each stimulus associated with a test for testing a 
particular reading or pre-reading' skill of the individual, the skills indicating the risk that the 
individual develops a language-based learning disability. The method further comprises 
receiving a response from the individual to each stimulus, scoring the user's responses to each 
test, and recommending, based on the scores of the one or more tests, one or more training 
modules for improving a reading or pre-reading skill of the individual as indicated by the score 
of the tests. 

Brief Description of the Drawings 

Figure 1 A is a block diagram illustrating a first embodiment of a computer-based 
phonological skills diagnostic system in accordance with the invention; 

Figure IB illustrates a second embodiment of a computer-based phonological skills 
diagnostic system in accordance with the invention; 

Figure 1C illustrates more details of the second embodiment of the computer-based 
phonological skills diagnostic system in accordance with the invention as shown in Figure IB; 

Figure 2 is a diagram illustrating a Web-based server computer that may be a part of the 
diagnostic system of Figure 1; 

Figure 2A graphically illustrates a method for determining a particular error of a user of 
the diagnostic system; 

Figure 2B is a flowchart illustrating a preferred method for identifying a particular 
deficiency of a user of the diagnostic system; 
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Figure 2C illustrates the IF-THEN rule bases used to determine a user's deficient skill 
areas based on the incorrect answers in particular subtests; 

Figure 2D illustrates an example of one or more subtests of the diagnostic system and the 
error measure associated with the particular subtest; 

Figure 3 is a diagram illustrating a preferred embodiment of the diagnostic tool of Figure 
2 in accordance with the invention including one or more tests that are used to diagnose a 
reading problem of a child; 

Figure 4 is a flowchart illustrating filling out a questionnaire in accordance with the 
invention; 

Figure 5 is a flowchart illustrating a method for testing a child's recognition of rhymes; 
Figure 6 is a diagram illustrating an example of how the child's rhyme recognition ability 
may be tested in accordance with the invention; 

Figure 7 is a flowchart illustrating a method for testing a child's ability to generate a 

rhyme; 

Figure 8 is a diagram illustrating an example of how the child's rhyme generation ability 
may be tested in accordance with the invention; 

Figure 9 is a flowchart illustrating a method for testing the child's ability to distinguish 
the beginning and ending sounds of a word; 

Figure 10 is a diagram illustrating an example of how the child's ability to discern the 
beginning and ending of words may be tested in accordance with the invention; 

Figure 1 1 is a flowchart illustrating a method for testing a child's ability to blend sounds; 

Figure 12 is a diagram illustrating an example of how the child's ability to blend sounds 
may be tested in accordance with the invention; 

Figure 13 is a flowchart illustrating a method for testing a child's ability to segment 
sounds; 



EMY7061629.6 
2100632-991121 



Attorney Docket No. 2100632-991121 



-8- 



Figure 14 is a diagram illustrating an example of how the child's ability to segment 
sounds may be tested in accordance with the invention; 

Figure 1 5 is a flowchart illustrating a method for testing a child's ability to manipulate 
sounds; 

Figure 16 is a diagram illustrating an example of how the child's ability to manipulate 
sounds may be tested in accordance with the invention; 

Figure 17 is a flowchart illustrating a method for testing a child's ability to recall spoken 
items in sequential order; 

Figure 18 is a diagram illustrating an example of how the child's ability to recall spoken 
items in sequential order may be tested in accordance with the invention; 

Figure 19 is a flowchart illustrating a method for testing a child's ability to rapidly name 
visually-presented items; 

Figure 20 is a diagram illustrating an example of how the child ' s ability to rapidly name 
visually-presented items may be tested in accordance with the invention; 

Figure 21 is a flowchart illustrating a method for testing a child' s ability to name letters 
and associate sounds with symbols; 

Figure 22 is a diagram illustrating an example of how a child's ability to name letters and 
sound/symbol associations may be tested in accordance with the invention; 

Figure 23 is a flowchart illustrating a method for testing a child's ability to decode words; 

Figure 24 is a diagram illustrating an example of how a child's ability to decode words 
may be tested in accordance with the invention; 

Figure 25 is a flowchart illustrating a method for testing a child's ability for fluent 
reading; 

Figure 26 is a diagram illustrating an example of how a child's ability for fluent reading 
may be tested in accordance with the invention; 
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Figure 27 is a flowchart illustrating the operating of the training module recbmmender in 
accordance with the invention; 

Figure 28 illustrates an example of a report that is generated by the computer-based 
phonological skills diagnostic system in accordance with the invention; ■ . . 

Figure 29 illustrates an example of a test section selection drop down menu in accordance 
with the invention; and 

Figure 30 illustrates an example of a data graph selection drop down menu in accordance 
with the invention. 

Detailed Description of a Preferred Embodiment 

The invention is particularly applicable to a World Wide Web (Web) based diagnostic 
system for determining a child's phonological awareness and processing skills and reading skills • 
and it is in this context that the invention will be described. It will be appreciated, however, that 
the system and method in accordance with the invention has greater utility since it may be 
implemented on other types of computer systems, such as the Internet, a local area network, a 
wide area network or any other type of computer network. The system may also be used to test a 
variety of other individuals, such as illiterate and mentally disabled people, individuals whose 
native language is not English who are learning to read, and adolescents and adults who read 
poorly and wish to improve their reading skills. 

Figure 1 A is a block diagram illustrating a first embodiment of a computer-based 
phonological skills diagnostic system 50 in accordance with the invention. In this embodiment, 
the diagnostic system 50 may include a server 52 and one or more client computers 54 (Client # 
1 - Client #N) connected together by a communications network 56, that may be the Internet, the 
World Wide Web (the Web), a local.area network, a wide area network or any other type of 
communications network. In the embodiment shown, the communications network is the Web 
and a typical Web communications protocol, such as the hypertext transfer protocol (HTTP), 
may be used for communications between the server and the client computer. In particular, the 
server may download one or more Web pages to each client computer and each client computer 
may send responses back to the server. 
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The server may further comprise a central processing unit (CPU) 58, a memory 60, a 
database (DB) 62, a persistent storage device 64 and a diagnostic tool 66. In a preferred 
embodiment, the diagnostic tool may be one or more software applications (testing different 
phonological awareness and processing skills or reading skills) stored in the persistent storage of 
5 the server that may be downloaded into the memory 60 (as shown in Figure 1 A) so that the 
diagnostic tool may be executed by the CPU 58 of the server. In the preferred Web-based 
embodiment, the DB 62 or persistent storage device 64 may store one or more Web pages 
associated with the diagnostic tool 66. The Web pages may be downloaded to each client 
computer when the client computer requests the particular Web page. The server may also 
~jo include the necessary hardware and software to accept requests from one or more client 

computers. In the preferred embodiment, the Web pages may be communicated to the one or 
more client computers using the HTTP protocol and the client computers may send data back to 
the server, such as test responses, using the same protocol. 
if * Each client computer 54 (Client # N will be described herein, but it should be realized 

p ; 5 that each client computer is substantially similar) may be used by an individual user, such as a 
fy parent of a child or a test administrator, to access the diagnostic tool stored on the server. Each 
£ client computer 54 may include a central processing unit (CPU) 70, a memory 72, a persistent 
& storage device 74 such as a hard disk drive, a tape drive, an optical drive or the like, an input 

device 76 such as a keyboard, a mouse, a joystick, a speech recognition microphone or the like, 
20 and an output device 78 such as a typical cathode ray tube, a flat panel display, a printer for 
generating a printed report or the like. Each client computer may also include a browser 
application 80 that may be stored in the persistent storage device and downloaded to the memory 
72 as shown in the figure. The browser application may be executed by the CPU 70 and may 
permit the user of the client computer to interact with the Web pages being downloaded from the 
25 server 52. In this system, multiple client computers may establish simultaneous communications 
sessions with the server and each client computer may be downloading Web pages from the 
server. The system 50 thus permits multiple client computers to access the diagnostic tool 66 
stored on the server so that the user of each client computer may take advantage of the benefits 
of the diagnostic tool. 
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As described below in more detail, the diagnostic tool may include one or more different 
tools that test various phonological awareness or processing skills.as well as reading skills so that 
a child's proficiency at phonological awareness and processing skills and reading skills may be 
determined. The diagnostic tool 66 may also use a child's scores on the one or more tools in 
order to recommend to the user of the client computer (e.g., the parent of the child) which 
training tools the parent may consider downloading to help the child with any deficiencies. 
These training tools may also be stored in the persistent storage device 64 connected to the server 
so that the user may then download the training tool from the server as well. The training tools 
are described in more detail in co-pending U.S. patent application serial numbers 09/039,194 
and 60/103,354, filed March 13, 1998 and October 7, 1998, respectively, that are incorporated 
herein by reference and owned by the same assignee as the present application. The incorporated 
applications also describe the different sounds units types, syllable types and phoneme types that 
may be tested using the diagnostic system since these types of sound units, syllables and 
phonemes are similar to the types of sound units, syllables and phonemes used in the training 
tools. 

In another embodiment of the invention, an assessment tool software application, such as 
a Windows exe file for example, may be downloaded from the server to the client computer. 
The assessment tool software application may then be executed by the CPU 70 of the client 
computer. The assessment tool may then generate the graphical screens that test the different 
user's skills and may store the information/scores about the tests locally in the client computer. 
Then, during the assessment testing or after the assessment tool execution has been completed, 
the scores for the user may be uploaded back to the server computer. Now, a second 
embodiment of the computer-based phonological skills diagnostic system in accordance with the 
invention will be described. 

Figure IB illustrates an example of a second embodiment of a computer-based 
phonological skills diagnostic system 50 in accordance with the invention. In this embodiment 
of the invention, there may be the server 52 (whose elements and functions are described above 
and will not be described herein) that is connected via the communications network 56 to one or 
more clients as above. In this embodiment, each client may be a teacher computer system 84, 
such as a server computer, a local area network server computer or a personal computer that is 
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connected to a network, (Teacher Station 1, Teacher Station 2, .... Teacher Station N) that is 
connected to the server 52 over the communications network 56. The teacher station may have 
similar elements to the clients shown in Figure 1 and like elements have like reference numerals 
and will not be described here. To implement the diagnostic system in accordance with the 
invention, the CPU 70 of the teacher station may execute a diagnostic tool module 85 (that may 
be one or more pieces of software or one or more software applications) wherein the diagnostic 
tool module 85 resides in the memory 72 as shown. The teacher station 84 may be connected 
and control a computer network 86, such as an internal computer network within school or a 
computer network within a school district, etc. ... The computer network 86 may be connected to 
one or more student computers 87 (Student 1, Student 2,. .., Student N) wherein each student 
computer may be a computing device with sufficient resources to implement the diagnostic 
testing in accordance with the invention. For example, each student computer 87 may be a 
typical personal computer and may have the elements of the clients 54 shown in Figure 1 or it 
may be a personal digital assistant. 

In this embodiment, the diagnostic tool may be downloaded to the teacher station 84 from 
the server 52 when the particular school or school district purchases a license to the diagnostic 
tool. The teacher station may execute the diagnostic tool and control the operation of the student 
computers 87 to implement the diagnostic testing. This embodiment of the invention may be 
used, for example, to permit the teacher station (a LAN server) to monitor and control the 
diagnostic testing when the diagnostic tool is being used by multiple users in a school or other 
setting. More details of this embodiment of the invention will now be described. 

Figure 1C illustrates more details of an example of the second embodiment of the 
computer-based phonological skills diagnostic system in accordance with the invention as shown 
in Figure IB. In particular, the teacher station 84, the computer network 86, such as a local area 
network, and the one or more student computers 87 are shown and described in more detail. In 
operation, a school purchases the program (or the school district purchases the program and 
assigns the program to a school) and the school is given a User ID and password for access. The 
school may then download the program from the server 52 onto the school's LAN Server 84 
(teacher station). The teacher station performs the function of communicating with the server 52 
(not shown) in order to, for example, download the program and send back students' test results. 
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The teacher station may also communicate with the one or more student computers 87 in order 
to, for example, monitor students' test progress, control the start, volume, pause, resume, exit 
functions for all of the students and/or any individual students and collecting students' testing 
data. In this example of the embodiment, the testing environment presumes a networked 
environment with Internet access and the Xtranet Xtra installed. The Xtranet Xtra facilitates 
messaging between networked machines. The teacher/administrator would have an 
administrative version of the Testing Module. 

On the teacher station 84, the classroom teachers/ test administrator may register each 
student who will take the test and generate a classroom layout to assign students to particular 
student computers 87. The teacher station may also permit the classroom teacher/ test 
administrator to generate a layout for multiple different classes. As shown in Figure 1C, the 
teacher station may display one or more icons 88 wherein each student's computer is numbered. 
In a preferred embodiment, the icons are shown in a seating chart arrangement so that the teacher 
can easily determine which student is represented by which icon. Each icon may be one or more 
predetermined colors wherein each color indicates a particular status of the testing for the student 
using that computer. For example, a green colored icon may indicate an on going test, a yellow 
colored icon may indicate a paused test and a red colored flashing icon may indicate that help is 
needed. To view additional information about a particular student, the administrator may click 
on the icon that represents the student's computer and be presented in the student information 
area 89 with additional information about the particular student, such as the student's name, age, 
grade, type of test he/she is taking, and the progress of the test (e.g., "Rhyme Recognition 8" 
which is test item 8 of the Rhyme Recognition test section). 

In addition, an interface may be displayed that shows 1) how many tests are currently 
available and what type of tests can be assigned to each student (since the school may purchase a 
license to a particular number of tests at any one time); and 2) how many tests are currently in 
process and what kind of tests have already been assigned. In a preferred embodiment, a student 
can be assigned to more than one test. 
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The teacher station user interface may further include an activated student information 
area 89 wherein the information for a particular student is shown that has been selected by the 
administrator/teacher by clicking on the student's icon as described above. This area 89 may 
further include one or more buttons 90 that permit the administrator to control the testing of the 
individual selected student. The user interface may further include a second area 91 wherein the 
testing status is shown. For example, the area may indicate a failed connection with the student 
computer or server 52, a completed test and data being sent (or data is sent) to the server 52. 
This area 91 may also include one or more buttons 92 that permit the administrator/teacher to 
control the testing of all of the student's computer at the same time. Now, the process of 
registration and access using this embodiment of the invention will be described. 

To use the above embodiment of the system with a group of students, such as in a school 
or school district, it is necessary to register. In particular, there may be two kinds of registration 
including individual registration and institutional registration. A preferred embodiment of each 
type of registration will now be described. 

Individual Registration 

An "Individual" is defined as an online client wanting to purchase one or a number of 
Single Test packages for immediate use. First, an individual registers by completing an 
Individual Registration form wherein the individual assigns to herself a username and password 
(as well as a hint, should she forget her password). Upon submission of a valid Individual 
Registration form, a record is created in the Account table on the server 52 and the individual is 
assigned a unique accountid. The individual who creates the account is known as the Account 
Manager, and has responsibilities and access for the account. Next, a record is created in the 
Pswd table on the server 52 and stamped with the account id and assigned the default access 
level of "Individual". 

The individual may now purchase one or more test packages. Next, the individual selects 
a Single Test package appropriate for a child (e.g., Package "1 A") and a record is created in the 
Order table and assigned a unique order_id and stamped with the account id. A record is also 
created in the Order Item table. The order item record is assigned a unique order_item_id and 
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stamped with the accounted, orderid and packageid. Each order item is assigned a unique 
orderitemid and stamped with the dccountid arid order id. Now, the individual must 
complete and submit a Student Registration form for each child, which assigns the test to the 
particular child Then, a record is created in the Student table on the server 52 and the child is 
assigned a unique studentjid. The child's record is stamped with the accountid and 
order item id. The individual may now repeat the process, selecting additional Single Test 
packages and assigning one child to each package-. The ordering process has now been 
completed. 

The order is then validated by a third party, such as CyberCash or RediCash. If 
validation succeeds, the validated field in the Order table on the server 52 is marked TRUE and 
records are created in the Usage table with one record for each test. In particular, each Usage 
record is assigned a unique usage_id and stamped with the account_id, order id and 
order item id. If validation fails, the individual is notified and all records bearing both the 
accounted and order id in the Order, Order item and Student tables are deleted. Now, the 
institutional registration process will be described. - 

Institutional Registration 

An "Institution" is defined as a public or private school or other educational or child care 
institution wanting to purchase Single Test or 35-Test packages for use by a school district or 
school. A "School" is defined as any school within a school district', or any single institutional 
element such as a parochial or private school, a day care center, a commercial learning center. A 
public "School District" is any school district listed by the National Center for Education 
Statistics. A public school is any school listed by the National Center for Education Statistics 
and associated with a school district. An "Account Manager", is any individual who registers the 
account, orders and accepts responsibility for payment. The account manager has access to 
school-district level data if he/she purchases packages for a school district. The account manager 
is responsible for assigning test packages to schools and lead teachers within the school district. 
The account manager may assign himself as a lead teacher and the institution of record as the 
School (as is the case of a single school). A "Lead Teacher" is responsible for school packages 
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and assigns packages to classroom teachers. A classroom teacher is a test administrator and 
monitors the actual testing. The classroom teacher is given access by the lead teacher to register 
students so that they may take the test. The lead teacher has access to school level data and the 
classroom teacher has access to class level data. The system may impose certain restraints on the 
diagnostic tool, such as 1) test packages purchased by a school district may only be distributed 
within the district; and 2) one test package must be assigned to only one school; i.e., Students at 
different schools may not share one test package. 

To better understand the differences between the account manager, the lead teacher and 
the classroom teacher, an example of the diagnostic tool registration and testing process that 
involves all three different people will now be described. The account manager, the person who 
purchases the packages for the school district, is responsible for assigning packages to schools 
and a lead teacher for each school. The lead teacher assigned to a school is responsible for 
assigning packages to classroom teachers. The classroom teachers are responsible for registering 
students and administering the test. Later, after the test, the classroom teacher has access only to 
view his/her own classes' students' test results although it is possible for two teachers share one 
package. For example, for a package for 35 students, Mr. L (class 1 teacher) was assigned 20 
and Ms. D (class 2 teacher) was assigned 1 5. They can each test students at the same time using 
this same package, but Mr. L can only assign his own 20 students and view his own 20 students' 
test results; and Ms. D can only assign her own 1 5 students and view her own 1 5 students' test 
results. The lead teacher who was assigned to a school has access to school level to view his/her 
own school students' test results; and the account manager, who represents the school district, 
has an access to school district level to view his/her own school district students' test results. 
Now, the registration process will be described in more detail. 

To start the registration process, an institution registers by completing an Institution 
Registration form. Upon submission of a valid Institution Registration form, a record is created 
in the Account table in the server 52 and the account manager is assigned a unique account id. 
The account manager has responsibilities and access for the account. The Institutional 
Registration form requires that an institution specify a public school district if it wishes to 
distribute its packages among schools within the district. Or, conversely, the institution may 
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register as a single school, in which case all the packages it purchases must be used within that 
school. The account manager who submits the registration assigns to herself a username and 
password (as well as a hint, should she forget her password). A record is then created in the 
Pswd table on the server 52 and stamped with the accountid and assigned the default access 
5 level "Institution". The "Institution" level allows access to data as described above. 

School District Registration 

If the form identifies the account as a "School District" account, a record is created in the 
School District table in the server 52 with a unique schooldistrictid and the record is stamped 

si 

3 with the account id. Optionally, the account manager may create records in the Region table, 

if* 

£10 with unique regionids. These records are stamped with the account id and school district id. 

m 

2 Single School Registration 

If the form identifies the account as a "School" (i.e., a single institution), a record is 
7 1 , created in the School table with a unique school_id and the record is stamped with the . 

= account id. Optionally, the account manager may create a record in the School District table to 

J5 

=| 5 which the school belongs, with a unique school district id and the record is stamped with the 
^ account id. Optionally, the account manager may create a record in the Region table, with 
unique region ids. These records are stamped with the accounted and school district id. 

Once the above registration is completed, the institution may purchase the tests. In 
particular, the account manager may now purchase test packages. In particular, the account 
20 manager selects a test package, enters the package quantity and adds the selection to her 

"shopping cart". The account manager may select additional items, specify the quantity and add 
them to the "shopping cart." The account manager may then submit the order. 

The order is then validated by a third party, such as CyberCash or RediCash. If 
validation succeeds, the validated field in the Order table is marked TRUE and records are 
25 created in the Usage table with one record for each test. In more detail, each Usage record is 
assigned a unique usage id and stamped with the account id, order - id and order item id. A 
record is also created in the Order hem table. The order item record is assigned a unique 



Li 
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orderjtemjd and stamped with the accountjd, orderjd and package Jd. Each order item is 
assigned a unique order Jtemjd and stamped with the accountjd and orderjd If validation 
fails, the individual is notified. All records bearing both the accountjd and orderjd in the 
School, SchoolDistrict and Region tables are deleted if validation fails. 

After validation, the account manager must now assign packages to schools and lead 
teachers. In particular, if the account is identified as type "School District", the account manager 
completes and submits School Registration form for each school. (The system may have NCES 
databases on the server for the account manager to select school districts and/or schools). A 
record is created in the School table and assigned a unique school Jd. The record is stamped 
with the accountjd and school_districtJd Optionally, the school may further be identified as 
part of a "Region". The account manager may now assign packages to a school or schools. An 
interface will inform the account manager of packages that are available to assign, which 
packages have been assigned and to what school. When a package is assigned, records are 
created in the Usage table, the number of records corresponding with the number of tests in the 
package. Each record is given a unique usage id and stamped with the accountjd, orderjd, 
order item id, school district id and school id 

The account manager may now assign lead teachers to school level access. The account 
manager may assign access to more than one lead teacher at each school, or assign access to one 
lead teacher at more than one school. The lead teacher has school level access to test data. The 
account manager is responsible for communicating Username and Password to assigned lead 
teachers. The lead teacher may assign classroom teachers to class level access. The lead teacher 
is responsible for communicating Username and Password to assigned classroom teachers. 
Now, the process for testing student in accordance with the invention will be described in more 
detail. 

Registering Students 

Teachers or account managers acting as "Teachers" may assign classroom teachers and 
classroom teachers may register students at any time after an order is validated. A "Class" is any 
arbitrary group designation for students taking a test (e.g., "Mr. Busy's Kindergarten"). A 
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teacher may first define a class wherein a "Class" is defined by a class name unique to the school 
and given a unique classjd. The class record is stamped with the teacherjd and schooljd 

Classroom teachers must complete a Student Registration form for each student. An 
interface will show how many and of what kind of tests are available to assign, how many and of 
what kind of tests have been assigned. The form will allow more than one test to be assigned to 
a student. The student is assigned to a class. When the form is submitted, a record is created in 
the Student table and assigned a unique student id The record is stamped with the accountjd, 
schooldistrictid, school id, package id and classjd 

Administrating Tests 

The testing environment presumes a networked environment with Internet access and 
the Xtranet Xtra installed. The Xtranet Xtra facilitates messaging between networked 
machines. The classroom teacher/test administrator would have an administrative version of 
the Testing Module. The classroom teacher must log in to access the module. When the 
classroom teacher accesses the Test administration area, he is presented with a Seating Chart 
of student computers that are in communication with the administrative computer via 
Xtranet. The classroom teacher is also presented with a list of registered students. The 
classroom teacher begins a testing session by assigning students to a computer. Each "Desk" 
on the seating chart, when clicked, displays the student's name, age, grade, type of test, and 
the process of the test in the student information area 89. The classroom teacher will have 
control over start, volume, pause, resume, and exit functions for all the students or at each 
Desk. The testing status information indicated in the area 91 includes whether 1) the 
diagnostic tool application is open; 2) a connection to the server 52 is tested and/or active; 3) 
the student diagnostic test on each student computer has started, paused, or completed; and 4) 
the test data for a particular diagnostic student test from a particular student computer is sent 
to the server 52. 

The Test Application on the Student's machine messages the server 52 via the 
Teacher's machine, and the server 52 returns data to the Application via HTTP. (This 
happens transparently within the Application). The Application, before it reaches the Access 
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screen, will test its connection to the Server 52. If the connection fails, the Application will 
not proceed. The classroom teacher is notified of the result of the connection test. When the 
student begins the test (e.g., the Student presses the "Yes" button on the test module access 
screen) the testing record of connection is marked as "completed". The testing record is 
retrieved from the Usage table by studentid and orderitemid and "completed" is marked 
TRUE. This in effect, debits the test holdings of the respective account. 

Taking the Test 

When the test starts, the Student's Test Application will request a list of test stimuli 
and their resources and commence to download those resources from the server 52. After a 
student has taken a test, most resources will already be cached locally, and the test may 
proceed with minimal downloads. The test will proceed even in the event of student timeouts 
due to inactivity. As the student answers the test, data is collected. At the conclusion of the 
test, that data is written to a temporary HTML page, which is then sent as a form to the server 
52. The Score table at the server 52 is updated with this form data. A test is concluded when 
the student answers the final test question OR when the classroom teacher clicks the EXIT 
button for the Student. In the preferred embodiment, no student or student score data will be 
held locally. The Teacher's machine will look for unsent files on student machines and 
attempt to resend them at a later time in the instance where a test is completed but the HTTP 
transmission fails. 

Viewing Data 

Test performance data (graphs and tables) will be displayed by an applet embedded 
within a Web page. The test performance data is username/password protected. An HTML page 
will send a find request in the form of a Transact-SQL statement to the test result database which 
returns a record set. The record set will be formatted for display by the embedded applet. 

Individual Accounts 

Individuals may view data by entering their username/password. Individuals will be able 
to view data for students who they have registered as set forth in more detail in Appendix A. 
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Institutional Accounts 

Account managers may view data by using their username/password. Account managers 
may view and print data at the highest level of their access, typically at the School District Level. 
This entitles them to view individual and summary data by District, Region, School, Class and 
Student as set forth in more detail in Appendix A. Lead teachers may view data by using their 
username/password. Lead teachers may view and print data at the highest level of their access: 
the School Access Level. This entitles them to view individual and summary data by school, 
class and student. Classroom teachers may view and print data at a Class Access Level using 
their username/password. .This entitles them to view individual and summary data by class and 
student. The details of the data reporting feature of the diagnostic system in accordance with the 
invention will be described in more detail below with reference to Figure 28 and Appendix A. 
Now, more details of the Web-based diagnostic system will be described. 

Figure 2 is a diagram illustrating the Web-based server computer 52 that may be a part of 
the diagnostic system of Figures 1 A, IB and 1C. The server 52 may include the CPU 58, the 
memory 60, the DB 62, the persistent storage device 64 arid the diagnostic tool 66. The 
diagnostic tool may further comprise a user interface (UI) 100, a test section 102, a scorer 104, 
an administrator 106, a recommender 108 and a motivator module 109. The user interface may 
download the Web pages to each client computer as the Web pages are requested and receive the 
responses back from the client computers. The test section 102 may contain links to one or more 
different diagnostic tests (stored in the persistent storage or the DB) that may be used to 
determine a child's proficiency at a particular phonological awareness skill or reading skill as 
described in more detail below. Each test may have the child play a graphical game in which 
some skill of the child is being tested without the child knowing that a test is being performed. 
This type of game-based testing may reduce the child's anxiety about taking a test. The child 
may interact with each test and respond to the test with responses. In accordance with a 
preferred embodiment of the invention, the user/student taking the tests in the assessment tool do 
not see the scores of the tests since those scores are only provided to the teacher or parent of the 
user. Those responses are uploaded to the server and gathered by the scorer 104. The scorer 
may accumulate the total score for each test and then store the score in the DB 62. Since the 
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scores from the tests are automatically gathered and stored by the scorer into the DB, the system 
helps to generate accurate scores, permits the scores from different children to be compared to 
each other and permit a child's progress to be tracked based on the changing scores of a child 
over time. An example of the report generated by the scorer in accordance with the invention is 
described below with reference to Figure 28 and Appendix A. The scorer 104 may also include 
statistical analysis mechanisms for determining various statistics about the scores of one or more 
children using the diagnostic tool. 

The administrator 106 may perform various administrative actions such as monitoring the 
user of the diagnostic tool, billing the users (if appropriate) and the like. The recommender 108 
may use the scores and statistical information generated by the scorer, if requested by the user of 
the client computer, to recommend one or more training tools that may be used by the child 
taking the tests on the particular client computer in order to improve the child's ability in any 
deficient areas. For example, the scores may indicate that the child has weak/below average 
rhyme recognizing skills and the recommender may recommend that the child play the rhyme 
recognizer training tool in order to boost the child's rhyme recognition abilities. The parent may 
then download the training tool from the system. The recommender permits a parent of the 
child, who has no experience or knowledge about reading disorders or phonological awareness 
and processing deficits, to have their child tested for these deficits at home and then have the 
system automatically recommend a training tool that may help the child improve in any deficient 
areas. In particular, the recommender may be one or more pieces of code in a preferred 
embodiment that analyze the incorrect responses to one or more different subtests in order to 
determine the skill areas of a particular user that are deficient so that a training module that trains 
that particular deficient skill area can be recommended to the user of the diagnostic system. The 
recommendation module in accordance with the invention will now be described in more detail 
with reference to Figures 2A - 2D. 

Figure 2A graphically illustrates a method 800 for determining a particular phonological 
error of a user that is using the diagnostic system. For each subtest, such as the Rhyme 
Recognition subtest, the Rhyme Generation subtest, the Beginning and Ending Sound subtest, 
the Blending subtest, the Segmentation subtest, the Manipulating subtest, etc. .. shown in Figure 
2A, the diagnostic system stores the incorrect responses to each question. For example, as 
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shown for the Rhyme Recognition subtest, there may be three incorrect responses for test items 
2, 3, and 6 wherein each test itemtests a different aspect of the rhyme recognition skills. As 
shown, the incorrect responses are sorted by the type of error that is likely occurring based on the 
particular incorrect response wherein those differences are shown graphically in Figure 2 A, but 
are stored digitally in a database in the preferred embodiment. In this example, two of the 
incorrect responses indicate the same type of error (for example, an open syllable rime error) and 
one indicates a different type of error (for example, a r-controlled vowel rime). In this manner, 
the data about the particular incorrect responses by the user stored in the database are mapped 
into the types of errors that are shown by the particular incorrect answer. The particular 
preferred software based method for determining the particular type of error based on the 
answers from a user to all of the subtests will now be described with reference to Figure 2B. 

Figure 2B is a flowchart illustrating a preferred method 810 for determining a particular 
deficiency of a user of the diagnostic system. To understand the flowchart shown in Figure 2B, 
there may be one or more indexes (/', j, I) that are used to indicate each subtest (ST)„ wherein / = 
1 . . . k; incorrect responses for each subtest item (IR), y , wherein ij >= 11, 12, lmax, . . . kl, k2, 

kmax (/=1 ... max); and error measure (EM), ; , wherein il = 1 1 , 1 2, , 1 max, . . . kl , k2, . . . , 
kmax (/ = 1 ... max). In particular, in steps 812, 814, 816, the indexes are set to one to begin the 
analysis process, . These indexes are then incremented as described below to analyze each 
incorrect response for each subtest wherein each incorrect response is compared to each error 
measure to determine the type of error. 

In step 818, the first incorrect response, IRn, for the first subtest, STi, is compared to the 
first error measure, EMn, to determine if the incorrect response is consistent with the first error 
measure. Each error measure is intended to compare a particular incorrect answer with a 
particular type of error as described in more detail below with reference to Figure 2D. In step 
820, the method determines if a type of error is identified (e.g., does the incorrect response 
indicate that the particular type of problem identified by the particular error measure is present 
for the particular user). If an error is identified based on the error measure, the error is labeled in 
step 822 and then stored in the database in step 824 for the particular user. Since there is only 
one error measure that matches each incorrect answer, the method will drop down to step 830 to 
analyze the next incorrect response against all of the error measures. 
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If an error is not identified, then the method determines if index / is a maximum (e.g., if 
all of the error measures have been analyzed) in step 826. If / is not at its maximum value (e.g., 
there are other error measures that need to be compared to the first incorrect answer for the first 
subtest), then / is incremented in step 828 (to compare the next error measure to the first 
5 incorrect answer to the first subtest) and the method loops back to step 81 8 to compare the next 
error measure to the first incorrect answer for the first subtest. Thus, using the loop containing 
steps 818, 820, 826 and 828, each error measure is compared to the first incorrect answer for the 
first subtest. 

q Once each error measure is compared to the first incorrect response for the first subtest 

JpO (e.g., / = max), the method determines if all of the incorrect responses (j = max) have been 
H analyzed in step 830. If all of the incorrect responses have not been analyzed, then the method 
m loops in step 832 to increment j (to analyze the next incorrect response) and loops back to step 
P? 816 to reset / = 1 so that the next incorrect response is compared to all of the error measures. 
3 Again, the loop 816,818, 820, 826, 828, 830, 832 compares each incorrect response for a 
5,5 particular subtest to each error measure and identifies any matching error measures. Once all of 
5 "H the incorrect responses (e.g.,./ = max) for a particular subtest have been analyzed, the method 
6 proceeds to step 834 in which the method determines if all of the subtests (e.g., i = k) have been 
analyzed. If all of the subtests have not been analyzed, then the index i is incremented in step 
836 to analyze the next subtest and the method loops back to step 814 to then analyze each 
20 incorrect response for the particular subtest by comparing each incorrect response to each error 
measure. Again, the loop 814, 816, 818, 820, 826, 828, 830, 832, 834 and 836 compares each 
incorrect response for each subtest to each error measure. 

In summary, the input (fR)n (incorrect response 1 of subtest 1) is provided and compared 
to (EM)n (error measure 1 of subtest 1, for example, open syllable rime). If the error is 

25 identified, label the error and store it in the database: Error Storage. If the error is not identified, 
continue comparing this incorrect response with the remaining error measures until the error is 
identified. Next, input QR) 12 (incorrect response 2 of subtest 1) and repeat the steps 2 and 3 to 
identify the error. When all the incorrect responses from subtest 1 are compared and errors are 
identified, labeled, and stored, input incorrect errors of subtest 2 one by one and compare them 

30 with error measures for subtest 2 as what was done for subtest 1 . Continue doing this until all 



EMY706 1629.6 
2100632-991121 



Attorney Docket No. 2100632-991121 -25- 



the incorrect responses from all the subtests are compared and labeled, and errors are stored in 
the database. Thus, the method in accordance with the invention compares each incorrect 
response for each subtest to each error measure to generate a database containing all of the errors 
that are identified for a particular user. Now, more details of the error measure and the 
comparison of the error measures to the incorrect responses will be described. 

Figure 2C visually illustrates an example of the IF-THEN rules used to determine a user's 
deficient skill areas based on the incorrect answers in particular subtests and Figure 2D illustrates 
an example of one or more subtests of the diagnostic system and the error measure associated 
with the particular subtest. With reference to Figure 2C, the circled numbers illustrate the code 
of an error measure for a particular subtest (shown in more detail in Figure 2D) and the lines 
illustrate the connections of all elements for a particular rule that indicates a particular skill 
deficiency. With reference to Figure 2D, the table illustrates one or more subtests, its associated 
error measure identification number (ID) and the actual error measure described. Thus, for 
example, for the Beginning and Ending Sounds subtest, the second error measure identification 
is "2" and the actual error measure is that the user does not recognize /f/ when it is at the end 
following an /if sound. Other examples of the error measures for different subtests are also 
shown. 

In accordance with the invention, there may be a plurality of error measures that are 
compared to each incorrect response by the user for each subtest to determine the type of user 
error that is indicated by the particular incorrect answer. For example, as shown in Figure 2C, 
each subtest may have one or more different error measures wherein the error measures are 
described in more detail in Figure 2D. Then, once the error measure for each subtest is 
identified, it is stored in the database. Then, one or more skill deficiencies of the user are 
determined based on the stored error measures. In particular, the database may include one or 
more rules that identify different skill deficiencies. Each rule may reach a conclusion about a 
particular skill deficiency based on one or more error measures. For example, a single error 
measure (based on a single incorrect answer) may indicate a particular skill deficiency or a 
combination of error measures (based on more than one incorrect answer) may indicate a skill 
deficiency. Thus, the recommender is capable of diagnosing skill deficiencies in a user in this 
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manner. Several examples that illustrate the rules set forth in Figures 2C (using graphic) and 2D 
(using text) will now be described. 

Figure 2C graphically illustrates three examples of rules in the recommendation module 
that indicate three different skill deficiencies. These examples, however, are merely illustrative 
and there may be a very large number of actual skill deficiency rules. Figure 2D illustrates the 
error measures that are being used in the rule examples shown in Figure 2C. In Figure 2C, the 
first rule (Rule 1) is indicated by a dashed line (- - - -), the second rule (Rule 2) is indicated by 

a solid line ( -) and the third rule (Rule 3) is indicated by a broken dashed line ( ). 

Thus, Figure 2C illustrates the combination of error measures that must be true for a particular 
user (indicating particular incorrect answers of the user) that in turn indicate a particular skill 
deficiency. Each example of a rule will now be provided in text below, (and shown graphically 
in Figure 2C) and then a more in-depth explanation of the first rule only is provided since it is 
assumed that the second and third rules will be understood once the first rule is explained. 

Rule 1 . If error measure .3. 2 is true (e.g., an incorrect response in the Beginning and 
Ending Sounds subtest (subtest 3) that matches error measure 2 in Figure 2D) and error measure 
4.3 is true, and error measures 5.4, 6.4, 7.3, 9.4 and 10.2 are true, then the skill deficiency is the 
/f/ sound. 

Rule 2: If error measures 3.2, 4.3, 5!4, 6.4, 7.3 and 10.2 are true, then the deficiency is the 
/f/ sound at the end of a word. 

Rule 3: If error measures 4.3, 6.4, 7.3 and 10.2 are true, then the deficiency is the lil 
sound at the end of a word following an Id sound or another consonant. 

In more detail, the first rule generally determines if the user has a problem understanding 
the lil sound in a word while the second and third rules determine if a particular location in a 
word of the lil sound is a problem. To analyze these rules, the database has stored the incorrect 
answers of the user along with the error measures that correspond to the incorrect responses. 
Then, each rule is compared to the error measures that are stored in the database which are true 
(indicating a particular incorrect response to a particular subtest) for the particular user to 
diagnose any skill deficiency areas. Thus, a deficiency in understanding the lil sound is 
diagnosed if the above identified error measures (indicated in Figure 2D) are true. Thus, based 



EMV706 1629.6 
2100632-991121 



Attorney Docket No. 2100632-991121 



-27- 



on a plurality of these rules, a specific deficiency (for example, deficiency of Ifl sound at the end 
following Id sound or another consonant vs. deficiency of lit sound) is identified and relevant 
training modules are recommended. Now, the motivator module 109 will be described in more 
detail. 

The motivator module 109 may generate motivation images and sounds to encourage the 
user/student to complete the tests associated with the assessment tool so that the user is less 
aware that he/she is being tested by the system. The motivation may also maintain the 
user/student's interest in the testing. In one embodiment, the diagnostic system may show one or 
more animals, such as monkeys, eating bananas as the user is completing the tests so that the 
user is rewarded and incentivized by the monkey's actions. In a preferred embodiment, there 
may be eleven different skills tests and the monkeys may be shown to the user after the first three 
tests are completed by the user, and then after the first six tests have been completed by the user, 
and finally after the first nine tests have been completed by the user. In this manner, the user is 
given a break between tests, given a chance to relax, and informed of the test portions completed 
and to be completed. For example, after the first three tests, the monkey may be eating three 
bananas representing the three completed test.sections and may say "I want more bananas. Help 
me get some more bananas" to encourage the student to complete the other tests in the diagnostic 
tool which are represented by the eight bananas on the tree. Thus, the motivation module 
encourages the user to complete all of the tests in the diagnostic tool. 

The diagnostic tool may also include speech recognition software that permits the various 
tests described below, to be used in conjunction with speech recognition technology (a 
microphone and speech recognition software) on the client computer to enhance the value of the 
diagnostic tests. For example, the child may see one or more items on the computer screen in 
rapid succession, speak the name of each item into a microphone that is interpreted by the speech 
recognition software in the client computer, transmitted to the server and compared to a correct 
response by the speech recognition software in the server so that the scorer may determine 
whether or not the child correctly identified each item. The tests that may benefit from the 
speech recognition technology will be described below. Now, a preferred embodiment of the 
diagnostic tool in accordance with the invention will be described in more detail. 
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Figure 3 is a diagram illustrating a preferred embodiment of the diagnostic tool 66 
including one or more tests 102 that are used to diagnose a reading problem of a child by testing 
various phonological awareness and processing skills and pre-reading skills of the child. In a 
preferred embodiment, the one or more tests 102 may each be a separate software application 
module that may include a user interface portion 1 1 1 containing one or more Web pages. Each 
test 102 may display images on the display of the client computer that test a particular 
phonological awareness skill of the child and receive responses from the child that are used to 
determine a score for the child. In the preferred embodiment, the diagnostic tool may include, 
for example, a questionnaire module 1 10, a rhyme recognizer module 1 12, a rhyme generator 
module 1 14, a beginning and ending sound or sound unit recognizer module 1 16, a sound 
blender module 120, a sound segmenter module 122, a sound manipulator module 124, a 
sequential verbal recall module 126, a rapid item naming module 128, a letter naming and 
sound/symbol association module 130, a word decoder module 132 and a fluent reader module 
134. As described above, each module may embody a test that tests a particular phonological or 
reading skill of the child that may affect the child's ability to read. 

The questionnaire 1 10 is a fill-in form that permits the system to look for particular risk 
factors that may lead to reading deficiencies as described below with reference to Figure 4. The 
rhyme recognizer module 1 12 determines the child's ability to recognize a rhyme as described 
below with reference to Figures 5 and 6. The rhyme generator module 114 determines the 
child's ability to make rhymes as described below with reference to Figures 7 and 8. The 
beginning and ending sound or sound unit recognizer module 1 16 determines the child's ability 
the recognize the beginning and ending sounds in one or more words as described below with 
reference to Figures 9 and 10. The sound blender module 120 determines the child's ability to 
blend known sounds or sound units together to form new words as described below with 
reference to Figures 1 1 and 12. 

The sound segmenter module 122 determines the child's ability to segment a word into 
one or more sounds as described below with reference to Figures 13 and 14. The sound 
manipulator module 124 determines a child's ability to manipulate the sounds in a word as 
described below with reference to Figures 15 and 16. The sequential verbal recall module 126 
determines the child's ability to recall a series of sequential items shown to the child as described 
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below with reference to Figures 17 and 18. The rapid naming module 128 determines a child's 
ability to rapidly name one or more items as described below with reference to Figures 19 and 
20. The letter naming and sound/symbol association module 130 determines the child's ability 
to name the letters of the alphabet and associate sounds with symbols as described below with 
reference to Figures 21 and 22. The word decoding module 132 determines a child's ability to 
determine words based on one or more sounds as described below with reference to Figures 23 
and 24. The fluent reader module 134 determines the child's fluent reading ability as described 
below with reference to Figures 25 and 26. As described above and below, each module may 
use the speech recognition technology to enhance the testing process. Now, each of these 
modules will be described in more detail starting with the questionnaire. 

Figure 4 is a flowchart illustrating a questionnaire process 140 in accordance with the 
invention. The questionnaire permits the diagnostic system to gather information about an 
individual to be tested for the purpose of calculating the individual's risk for reading and 
academic failure. In particular, a variety of historical, environmental, familial and behavioral 
factors that have been closely linked with and are predictive of language-based reading and 
learning disorders may be determined. For example, the frequency of middle ear infections, a 
family history of dyslexia, socioeconomic status, exposure to literacy in the home, competencies 
in speech sound awareness, word retrieval,' verbal memory, speed sound perception and 
production and language comprehension and expressive language may provide information about 
an individual's risk for language-based reading and learning problems. 

In step 142, the questionnaire may display a first question to the user of the client 
computer, such as the parent of the child being tested. Next, the user may respond to the 
question using the user input devices and the user's response may be recorded by the 
questionnaire module in step 144. In step 146, the questionnaire module determines if all of the 
questions have been answered and goes to step 142 to present the next question to the user if 
there are additional questions. As long as there are remaining questions, the method will loop 
through steps 142 - 146. When the user has answered all of the questions, the questionnaire 
module may analyze the responses in step 148 to calculate a score and a risk factor value and 
then display the results of the analysis (including the responses and the recommendations of the 
system) to the user in step 150. The score may be calculated as the number of items checked as 
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being applicable to the user. Although a single factor does not indicate a risk, the more factors 
that exist for an individual, the more likely it is that the individual may experience difficulties. 

In analyzing the results of the questionnaire, the module may generate a category of the 
risk (high, medium or low) and then provide recommendations based on the category of risk. As 
5 an example, the questionnaire may ask if the child has a history of middle ear infections, if 
anyone in the family has reading or other learning disabilities and if the child mispronounces 
multi-syllabic words. The responses to these questions may be used to determine the category of 
risk of the person being tested. The category of risk determined based on the questionnaire may 
O then be used during the recommendation of training tools. Now, the rhyme recognition module 
iJO will be described in more detail. 



5 W 

in 



Figure 5 is a flowchart illustrating a method 160 for testing a child's recognition of 
fQ rhymes in accordance with the invention. The rhyme recognizer module tests the child's ability 
H° . to recognize rhyming words and, in order to determine if two words rhyme, the child must focus 
Q on the sounds of the words rather than the meaning. In addition, the child must focus on one part 
,=jj5 of the word rather than the word as a whole. A sensitivity to rhyming is typically a child's first 
4=j experience shifting their attention and focus from the content of the speech to the form of the 
p words. Typically, this skill for recognizing rhymes should emerge by 3-4 years of age. The 

module may show the child one or more different types of rhymes (using different sound units, 
for example) in order to assess the child's ability with different types of rhymes. 

20 At step 162, the rhyme recognizing module may display two words along with their 

pictures on the user's display screen as shown in Figure 6. For example, the module may display 
the picture of a sun and a picture of a gun. In step 164, the module may display text below the 
pictures asking the user if the two words rhyme. In a preferred embodiment, the module may 
present a verbal prompt asking the user if the two words rhyme since the users of the system may 

25 not be able to read. In step 166, the user may use the user input device, such as the keyboard, the 
mouse or the microphone of the speech recognition hardware, to respond to the question and the 
module may receive the response. In step 168, the module may determine if the response is 
correct. If the response is correct, the module may determine if there are other rhyme types to 
test in step 170. If there are more rhyme types to test, the module may display the word pair for 
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the next type of rhyme in step 172 and loops back to step 164 to display the question about 
whether the two words rhyme. If there are no more rhyme types to test, the module may 
calculate the child's score in step 174. The score may be calculated based on the percentage of 
pairs of items correctly identified as rhyming or not. In step 176, the module may display the 
score to the user and the recommender, based on the score, may recommend one or more training 
tools to help the child improve his rhyme identification skills. 

Returning to step 168, if the response given by the user is not correct, then the module 
may determine the number of consecutive errors of the particular rhyme type in step 178. In step 
180, the module may compare the number calculated above to a predetermined number and if the 
number of consecutive errors is more than the predetermined number, the module go to step 170 
to determine if there are other rhyme types to be tested (assuming that more tests for the current 
rhyme types are not productive since the user has already missed more than the predetermined 
number). If the number of consecutive errors is less than the predetermined number, then the 
module may display the next word pair for the same rhyme type in step 182 in order to continue 
testing the child's ability with that particular type of rhyme. In this manner, the rhyme 
recognizer module may test the child's abilities with respect to a variety of rhyme types to gain a 
better understanding of the child's deficiencies or abilities to recognize rhymes. For example, 
the module may determine that the child only has deficiencies with respect to certain types of 
rhymes. Now, an example of the user interface for the rhyme recognition module will be 
described. 

Figure 6 is a diagram illustrating an example of how the child's rhyme recognition may 
be tested in accordance with the invention. In particular, an image 190 that may be displayed on 
the user's display screen is shown. The image may include a picture of a first item 192 and a 
picture of a second item 194 and the child must determine if the names of the two items rhyme 
with each other. In this example, the items are a sun and a gun that do in fact rhyme. The image 
may also include displayed instructions 196 from the module and one or more response buttons 
198, 200, such as the "Yes" button and the "No" button in this example. As described above, the 
user may also respond to the query by using the keyboard or by speaking into a speech 
recognition microphone. In accordance with the invention, the rhyme recognition module may 
present the rhyme recognition test as a series of colorful images that reduces the child's test 
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anxiety since the child may not even realize that he/she is being tested. Now, the rhyme 
generation module will be described in more detail. 

Figure 7 is a flowchart illustrating a method 210 for testing a child's ability to generate a 
rhyme. The rhyme generation module assesses a child' s ability to focus on one part of a word 
5 rather than the entire word. The ability to rhyme indicates the emergence of phonological 

awareness and processing skills and is a good early indicator of later reading ability. Typically, 
this skill begins to show as the child is 3-4 years old. 

In step 212, the module may generate a word sound on the speaker of the user's computer 
Q and may display an image of the word being spoken. The module may also display a series of 
So other pictures of items in step 2 1 4 and the user must determine which item in the series rhymes 
iff with the spoken word. The module may then ask the user to select the rhyming item in step 2 1 6, 
S the user may provide a response using one of the input devices (keyboard, mouse or 
u microphone)/ Instead of a series of images being displayed to the user, the module may provide 
L a verbal prompt asking the user to generate a rhyming word and the user may speak the rhyming 
% word into the microphone of the speech recognition device. The module may then determine if 
% the user's response is correct in step 218. If the user's response is not correct, then the module 
p may determine the number of consecutive incorrect responses in step 220 and compare the 

calculated number to a predetermined number, n, in step 222. If the number of errors is less than 
the predetermined number (e.g., the user should be tested more on that rhyme type), the module 
20 may display the next image in step 224 and return to step 214. If the number of consecutive 
errors is greater than the predetermined number (e.g., it is no longer useful to continue testing 
this rhyme pair because the user does not understand it) or the user's response was correct, the 
module may determine if there are more rhyme types to test in step 226. If there are more rhyme 
types to test, then the module may display the items for the next rhyme type in step 228 and 
25 return to step 214 to elicit the user's response. If there are no other rhyme types (i.e., the user 
has completed the module), the module may calculate a score in step 230 (the score is equal to 
the percentage of items correctly identified as rhyming) and may display the results of the test 
and any recommendations from the recommender in step 232. The recommendations from the 
recommender are similar to those described above and therefore will not be described here. 
30 Now, an example of the rhyme generation test is described. 
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Figure 8 is a diagram illustrating an example of how the child's rhyme generation may be 
tested in accordance with the invention using an image 240. The image may include an image 
242 of the spoken word that may be a "pup" in this example. The image 240 may also include 
one or more images of other items 244 - 248 (a horn, a bed and a cup in this example) and 
displayed instructions 250 as shown. During the test, the user may hear the word "pup", see the 
picture of the "pup" and select the item below it that rhymes with the pup. In this example, the 
user is supposed to select the picture of the cup.: As above, instead of a series of images being 
displayed to the user, the module may provide a verbal prompt asking the user to generate a 
rhyming word and the user may.speak the rhyming word into the microphone of the speech 
recognition device. As above, the use of images to test the child's ability reduces the child's test 
anxiety since the child may not even realize that a test is being conducted. Now, more details of 
the beginning and ending sound recognizer module will be described. 

Figure 9 is a flowchart illustrating a method 260 performed by the beginning and ending 
sound recognizer module for testing the child's ability to distinguish the beginning and ending 
sounds of a word. In particular, the module tests a child's ability to recognize sounds in words. 
Once the child establishes the skill to recognize the beginning and ending sounds of a word, the 
child may more readily learn to isolate the sounds in a word and hear them separately. A normal 
kindergarten child is typically , able to identify which word in a group of three words begins with 
the same first sound as the target word. Most normal first grade students can perform the harder 
task of identifying the word in a group with the same last sound. 

In step 262, the module may present a spoken word naming an item and display an image 
of the item to the user. In step 264, the module may query the user about which item in a 
sequence of items has the same beginning sound as the item. The module may then receive a 
user's response from the user entering the response into the input devices as described above in 
step 266. In step 268, the module determines if the response is correct. If the response is not 
correct, the module may determine the number of consecutive errors for the particular beginning 
sound in step 270 and compare the calculated value with a predetermined value, n, in step 272. 
If the calculated value is not less than the predetermined value (i.e., the user should be asked 
more questions about that particular type of beginning sound), then the module may present the 
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user with another spoken word and picture in step 274 and return to step 264 to gather the user's 
response. 

Returning to step 268, if the response of the user is correct, the module determines if all 
of the beginning sounds in the test are completed in step 276 and either presents the next 
5 beginning sound in step 278 and returns to step 264 if there are other beginning sounds to test or 
begins testing the ending sounds. In particular, the module may present a spoken word and a 
picture of the item in step 280 and query the user about which item in a sequence of items has a 
similar ending sound in step 282. In step 284, the module may gather the user's response and 
determine if the response is correct in step 286. If the response is incorrect, the module may 
ig) determine the number of consecutive errors for the particular ending sound in step 288, compare 
j0 the calculated number to a predetermined number in step 290 and display a next word in step 292 
fU and returns to step 282 if the calculated number is less than the predetermined number. If the 
m calculated number is not less than the predetermined number or the user's response is correct, the 
r module may determines if the ending sounds has been completed in step 294. If the testing of 
p the ending sounds has not been completed then the module may present the next word in step 
J* 296 and return to step 282. If the ending sounds are completed, the module may calculate a 

ru 

J score based on the percentage of correct responses in step 298. In step 300, the module and the 
\1 recommender, respectively, may generate a display of the score and any recommendations about 

training tools that the user may use to improve his recognition of the beginning and ending 
20 sounds of a word. Now, an example of the user interface for testing the ability to discern the 

beginning and endings of words will be described. 

Figure 10 is a diagram illustrating an example of a user interface 310 of how the child's 
ability to discern the beginning and ending of words may be tested in accordance with the 
invention. In particular, the user interface may include a picture of the current word 312 that is a 
25 leg in this example, and a series of pictures 314 showing other items. The user must recognize 
the beginning sound of the leg and then determine which picture of an item shows an item with 
the same beginning sound. The user may then select an item by clicking on the item. In this 
example, the correct response is the lamp. Now, a method for testing a child's ability to blend 
sounds will be described. 
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Figure 1 1 is a flowchart illustrating a method 360 for testing a child's ability to blend 
sounds. In particular, the game tests the user's ability to blend units of sound such as syllables or 
phonemes together. The blending of these units of sound together requires a knowledge that 
individual sounds may be combined to form a word, but does not require letter recognition. The 
blending of sounds is an important reading skill since, when children sound out a word, they 
must be able to then blend all of the sounds together to form the whole word. Typical children 
normally develop the blending skill during the early kindergarten years. 

In step 362, the module may display one or more graphical representations of items and 
present a spoken word, with its sound units separated by equal intervals of time, to the user, such 
as "k-ey". The module may then ask the user to identify the graphical item referred to by the 
spoken word in step 364 and receive the response from the user using one of the input devices, 
such as the keyboard, mouse or microphone of the speech recognizer. In step 366, the module 
may determine if the response received is correct. If the response was not correct, the module 
may determine the number of consecutive errors for the current sound unit in step 368. In step 
370, the module may determine if the number of consecutive errors is less than a predetermined 
". threshold and present the next word with similar sound unit types in step 372 and loop back to 
step 364 if the number of consecutive errors is not less than predetermined threshold. If the 
number of consecutive errors is not less than the predetermined threshold or if the prior response 
was correct, the module may determine if there are other sound unit types to test in step 374. If 
there are other sound unit types, the module may present a word with sound units of the new type 
in step 376 and loop back to step 364 to test the child using the new sound unit type. If there are 
no more sound unit types to test, the module may determine the user's score in step 378 based on 
the percentage of correctly answered items. In step 379, the module may display the score to the 
user and the recommender may recommend one or more training tools that may help the user 
improve the blending sound ability and that may be downloaded from the diagnostic system. An 
example of the user interface for testing the blending of sounds will now be described. 

Figure 12 is a diagram illustrating an example of a user interface for testing a child's 
ability to blend sounds 380 in accordance with the invention. As shown, the user interface 380 
may include graphical representations 382-386 of one or more items, such as a key, a doll and a 
bell in this example, that the user may select in response to the spoken word's separated sound 
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units. As described above, the user may respond to the questions by clicking on the image, 
pressing a key on the keyboard or speaking a name into the microphone of the speech recognizer. 
In this example, the correct response is to select the key 382. Now, a method for testing the 
sound segmenting ability of a user will be described. 

Figure 13 is a flowchart illustrating a method 390 for testing a child's ability to segment 
sounds in which the user's ability to segment a unit of sound, such as a word, into its constituent 
sound units, such as syllables and phonemes, is tested. The ability to segment phonemes is a 
reliable predictor of reading success and usually is developed prior to and during kindergarten. 
In step 392, a sequence of sounds units, such as a sentence, is spoken to the user. In step 394, the 
user is queried about how many words the user heard and the response from the user may be 
shown graphically as shown in Figure 14. In the example shown in Figure 16, the sentence "I 
have two brothers" was presented to the user, the user activated an input device (clicked the 
mouse button, hit a key or spoke into the microphone) four times to indicate that four words were 
heard, and four items 395 are shown on the display. 

Returning to Figure 13, the accuracy of the user's response is checked in step 396. If the 
response is not correct, the number of consecutive errors is determined in step 398 and compared 
to a threshold value in step 400. If the number of errors is less than the threshold, the next 
sequence of sounds units is presented to the user in step 402 and the method loops back to step 
394. If the number of errors is not less than the threshold or the prior response of the user was 
correct, it is determined if there are more tests with a different sequence of sound units in step 
404. If there are more tests, a new sequence of sound units is presented in step 406 and the 
method loops back to step 394. If all of the tests have been completed, then the user's score is 
determined (as a percentage of correct responses) in step 408 and the score and any 
recommendations based on the score are displayed in step 410. Now, a method for testing a 
child's ability to manipulate sounds is described. 

Figure 1 5 is a flowchart illustrating a method 420 for testing a child's ability to 
manipulate sounds. In particular, the user's ability to manipulate phonemes is tested since that 
ability is highly correlated with reading ability through the 12 th grade. In step 422, the user is 
presented with a spoken word. In the example shown in Figure 16, the spoken word is "cake". 
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In step 424, a graphical representation of constituent sound units is displayed for the user. In the 
example shown in Figure 16, the graphical representations may be one or more blocks 426 (three 
for the word "cake" with the first and last blocks being the same color since the first and last 
sound units of "cake" have the same sound). In step 428, the user is asked to rearrange the 
blocks shown or use the available other blocks (as shown in Figure 16) to form a new word and 
the user rearranges the blocks with an input device. In the example, the user is asked to change 
"cake" to "cape". A correct response would be to have three blocks wherein a third block 429 
has a color that does not match the other two blocks indicating that the third sounds unit is 
different from both the first and second sound units. In step 430, the accuracy of the response is 
determined. If the response is not correct, the number of consecutive errors is determined in step 
432 and compared to a threshold value in step 434. If the threshold value is not exceeded 
5 (indicating that the same type of manipulation should continue to be tested), the next 
m manipulation of the same type is presented in step 436 and the method loops back to step 424. If 
f the number of errors exceeds the threshold (indicating that the child is having too much trouble 
35 with the current type of manipulation) or if the prior response was correct, it is determined if 

there are more types of manipulations to test in step 438. If there are more types to test, the next 
type of manipulation is presented in step 440 and the method loops back to step 424. If there are 
no more types of test, the score of the user is determined in step 442 (based on the percentage of 
correct answers) and the score and any recommendations are displayed to the user in step 444. 
20 Now, a method for testing the ability to recall spoken words will be described. 

Figure 17. is a flowchart illustrating a method 450 for testing a child's ability to recall 
spoken items in sequential order. The ability to recall a sequence of verbal material depends on 
the ability to accurately represent the essential phonological features of each item in working 
memory and phonological coding efficiency is a primary determinant of performance of this 
25 task. Typically, the ability to recall a list of spoken items increases with age from about 1 digit 
and 2 words at 4 years old to 8 digits and 6 words at 12 years old. In step 452, a sequence of 
words and/or digits is spoken with equal intervals between each word or digit through the 
speaker of the computer to the user. The user then repeats the sequence back using an input 
device such as a microphone of the speech recognizer in step 454. Figure 18 illustrates an 
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example of a sequence of digits that are presented to the user. In step 456, the response is 
checked for accuracy. 

If the response is not correct, then the number of consecutive errors is determined in step 
458 and the number of consecutive errors is compared to a threshold in step 460. If the threshold 
5 . is not exceeded, then the next sequence of words and/or digits is presented in step 462 and the 
method loops back to step 454. If the threshold is exceeded or if the last response was correct, it 
is determined if there are more types of sequence of words to test in step 464 and the method 
presents a new type of sequence in step 466 and loops back to step 454 if there are more types. 

« If all of the types of sequences have been completed, then the user's score is determined in step 

u * . 

£b 468 (as a percentage of correct responses) and the scope and any recommendations for training 

2 modules is displayed in step 470. Now, a method for testing rapid naming ability will be 

described. 

. Figure 19 is a flowchart illustrating a method 480 for testing a child's ability to rapidly 
^ name visually-presented items. In particular, an inability to name visual objects typically 
3i . underlies a reading disorder In step 482, an array 484 (an example of which is shown in Figure 

20 as a first row of a 4X6 array) is displayed to the user.. In step 486, a timer is started and the 
Q user is asked to name all of the items in the array as fast as possible in step 488 using an input 
^ . device such as a microphone of a speech recognizer. The timer may actually be started when the 

user makes his/her first response. After each response, the accuracy of the response is 
20 determined in step 490. If the response is not correct, then the number of consecutive errors is 
determined in step 492 and compared to a threshold in step 494. If the threshold is exceeded, the 
test is aborted. If the threshold is not exceeded, then the user continues to identify the items in 
the array. If the prior response was correct, then it is determined if there are more items to name 
in step 496 and the method loops back to step 488 if there are more items. If all of the items 
25 have been named, then the timer is stopped in step 498 and the score is determined in step 500 
based on the total time of the responses. In step 502, the score and any recommendations for 
training modules are displayed. Now, a method for testing the ability to name letters and 
associate sounds with symbols will be described. 
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Figure 21 is a flowchart illustrating a method 510 for testing a child's ability to name 
letters and associate a phoneme sound with a letter. The inability to name letters may indicate a 
reading problem at the kindergarten level while an inability to associate a phoneme sound with a 
letter may indicate a reading problem at the first and second grade level. In step 512, a letter's 
5 name is spoken to the user by the computer. In step 514, the user may identify the letter in an 
array of letters 516 (as example of which is shown in Figure 22) and select the appropriate letter 
using an input device. In step 518, the response accuracy is determined and it is determined if 
there are more letters. If there are more letters, the method loops back to step 512. If all of the 
letters have been completed, then a phoneme sound is generated by the computer and heard by 
Jjp the user in step 520. The user may then indicate the corresponding letter for the phoneme sound 
^ in step 522 and the accuracy of the response is checked. In step 524, it is determined if there are 
id? more phonemes to test and the method loops back to step 520 if there are more phonemes. If the 
03 phonemes have been completed, then the user's score is determined in step 526 and the score and 
^ any recommendations about training modules is displayed in step 528. Now, a method for 
S5 testing a child's ability to decode words will be described. 
N 

FU Figure 23 is a flowchart illustrating another method 530 for testing a child's ability to 

q decode words. In particular, the method tests a child's ability to decode (i.e:, read by sounding 
^ out) nonsense and real words since research has shown that the best measure of the ability to 

apply knowledge about grapheme -phoneme correspondences to reading words is a test of non- 
20 word phonemic decoding fluency. . 

At step 532, the module may display a set of words 533 on the screen (an example of 
which is shown in Figure 24) and then present a spoken word. In step 534, the module asks the 
user to identify the written word that was just spoken to the user. As above, the user's response 
may be provided using one of the input devices, such as the keyboard, mouse or microphone of 

25 the speech recognizer. Instead of speaking the word to the user, the module may present the 
word to the user is a visual manner. In step 536, the module determines if the correct response 
was received. If the response was not correct, then the module may determine the number of 
consecutive errors for the particular syllable type in step 538 and compares that calculated value 
to a predetermined threshold value in step 540 to determine if the calculated value is less than the 

30 threshold value. If the calculated value is less than the threshold, then the next spoken word for 
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the same syllable type is presented in step 542 and the method loops back to step 534 to 
determine the user's response. If the number of consecutive errors is greater than the threshold or 
the prior response was correct, the module may determine if there are more syllable types to be 
tested in step 544. If there are more syllable types to test, the module presents the next word for 
the next syllable type in step 546 and loops back to step 532 where a new spoken word is 
presented to the user. If there are no more syllable types to test, the module may repeat the 
above testing (not shown in the flowchart for clarity reasons) process for one or more nonsense 
words in step 548. Once the above testing process has been repeated for nonsense words by 
testing if it is completed in step 550 and looping back to step 548, the module may determine the 
score of the child in step 552 wherein the score is calculated as a percentage of items that have 
been correctly answered. In step 554, based on the score, the module may display the score and 
the recommender may recommend one or more training tools to improve the child's decoding 
skills if the score reveals a decoding deficiency. Now, a method for testing fluent reading will be 
described. 

Figure 25 is a flowchart illustrating a method 560 for testing a child's ability for fluent 
reading. Slow or inaccurate decoding interferes with the ability of the child or user to extract 
meaning from the text. A typical child may read and respond to 30 sentences of the nature 
presented in this diagnostic tool in two minutes. The sentences may be questions ("Is the dog 
red?") or statements ("The dog has fur.") to which the user responds. In step 562, a question 564 
is displayed to the user along with two answers 566 (an example of which is shown in Figure 
26). A timer is started in step 568 as the user makes his first response in step 570. In step 572, 
the accuracy of the response is determined. If the response is not accurate, then the number of 
errors made is compared to a threshold in step 574. If the number of errors are less than the 
threshold, then the method loops back to step 562 to continue testing. If the number of errors are 
more than the threshold or the prior response was correct, it is determined if the time exceeded 
two minutes in step 576. If the time is less than two minutes, then the method loops back to step 
562. If the time exceeds two minutes, the total number of correct responses is tallied and then 
the entire test is repeated in step 577 and the score of the user is determined in step 578. The 
total score of the user is calculated by determining the user's score for each two minute test and 
then averaging the scores from the two tests to arrive at a final score. For example, a user may 
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score 30 on the first test and 28 on the second test so that the final score is 29. In step 580, the 
score and any recommendations of training modules is displayed to the user. Now, the training 
module recommender in accordance with the invention will be described. 

Figure 27 is a flowchart illustrating the training recommender method 590 in accordance 
with the invention. The method identifies, recommends and makes available specific training 
modules based on an individual's or a group's assessment profile based on the results from the 
various tests performed by the diagnostic tool in accordance with the invention. In particular, the 
recommender may automatically recommend one or more training modules based on the test 
results. In step 592, the recommender gathers the data for the individual or group and analyzes 
it. In step 594, the recommender determines the individual or group's skill in each skill area 
tested by the diagnostic tool. In step 596, the recommender matches the skill level of the 
individual or group in a particular skill area with an appropriate training module. For example, 
the particular score of a user, such as close to normal, on a particular test, such as rhyme 
recognition, may cause the recommender to recommend a lowest level (least amount of training) 
of the rhyme recognition training tool to help the child. For a child with more rhyme recognition 
deficiencies, the recommender may recommend a higher level training tool with more rhyme 
recognition training. An another example, the particular scores of a user on the various syllable 
types in the rhyme recognition test may cause the recommender to recommend no training for 
open rime syllable types but to recommend training for closed rime syllable types. 

In step 598, the recommender may display the recommended training modules to the 
user. The user may then select the recommended training modules in step 600 and the training 
modules may be downloaded to the user's computer so that the user may use the training 
modules to improve the skill areas that require it. In this manner, the diagnostic system in 
accordance with the invention not only diagnoses reading problems using the various skill tests 
but also recommends training modules that may help improve a deficient skill. Thus, the 
diagnostic system makes it easy for a parent to have the child tested for deficiencies and then to 
receive the tools that help correct any deficiencies. Now, an example of a report that is 
generated by the diagnostic system in accordance with the invention will be described. 
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Figure 28 illustrates an example of a user interface 700 displaying a data report that is 
generated by the computer-based phonological skills diagnostic system in accordance with the 
invention. Further details of the data reporting in accordance with the invention are contained in 
Appendix A which is incorporated herein by reference. In accordance with the invention, there 
may be two types of data reports including a graph and a table. A data graph (as shown in the 
example shown in Figure 28) or a data table displays data to show individual students' test 
results of all the subtests and compare the test results (total score comparison or individual 
subtest score comparison) among students, across classes or schools. The data tables can be 
sorted by scores and provide normative data for comparison. Now, the example of the data 
graph in accordance with the invention will be described. 

The data graph shown in Figure 28 may provide various information to a user of the 
system. In this example, the data graph illustrates the percentage correct for a particular test 
(Rhyming Recognition in this example) for a particular school class (Ms. Davis' Class 1 A at 
Central School in this example). As shown, this graph illustrates the percentage correct of one or 
more students (Melissa, Robert, Ken, Beth, etc. in this example) at different points in time. In a 
preferred embodiment, the full names of the students are shown on the data report. In this 
example, each student's score (a percentage of correct answers in the Rhyming Recognition test) 
prior to any training (pre-test), after a first round of training and testing (post-test 1) and after a 
second round of training and testing (post-test 2) are shown. In a preferred embodiment, the 
different scores are color coded for easier viewing so that, for example, the pre-test score is a 
green bar, the post-test 1 score is a blue bar and the post-test 2 score is a red bar. As shown, each 
bar lists the actual percentage that is represented by the bar, but that percentage can be 
suppressed by clicking on a button 702 on the user interface. In particular, when the button is 
clicked, all the percentages on the screen are hidden and the button will change to Show 
Percentages. When the Show Percentages button is clicked, all the percentages will be shown on 
the screen and the button changes back to Suppress Percentages. 

The user interface may include an "Other Test Section" button 704. If the user clicks on 
the "Other Test Section" button, a drop menu 740 (an example of which is shown in Figure 29) 
appears that shows all of the subtest titles that can be selected by the administrator/teacher. 
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Using the menu, a teacher can select a subtest to see students test results on this particular 
subtest. Thus, the data graph is dynamic in that the teacher/administrator can change the data 
shown in the graph at any time. The user interface may further include a zoom button 706 that 
permits the teacher to change the number of students whose data is displayed on the graph. For 
example, there may be 18 students in the class shown in Figure 28, but the graph shown in 
Figure 28 only shows the test results for six students. By clicking on the Zoom Out button, the 
teacher can see all the students' test results but details for each student will be missing so that the 
data can fit into the graph and the button will change to Zoom In. When the Zoom In button is 
clicked, the default six students' test results will be shown on the screen and the button will 
change back to Zoom Out. The purpose of having the zoom out function is to provide a general 
picture of the class performance. 

The user interface may further include a back button 708 that permits other student scores 
to be displayed in the graph while retaining all of the data about each student. In other words, 
the graph defaults to showing a predetermined number of students, such as six, and the back 
button permits the teacher to browse through the detailed scores of the entire class by viewing a 
predetermined number of students at a time. For example, if the six students shown on the 
screen are the first six in the class, then this button will be inactive since there are no prior 
students. However, when the six students on the screen are not the first six, clicking on this 
button will show the previous six students' full test results. The user interface may also include a 
forward button 710 that permits the teacher to see the full scores for the next predetermined 
number of students. Thus, if the students shown on the screen are the last six in the class, then 
this button will be inactive. When the six students on the screen are not the last six, clicking on 
this button will show the next six students' test results. Using the back and forward buttons, the 
teacher is able to browse through the full test results for the entire class 

The user interface may further include a graph display button 712. When the 
teacher/administrator clicks on the button, a drop down menu 750 with small graphs will shown 
(as shown in Figure 30) for the teacher to choose a data display she prefers. For example, as 
shown in Figure 30, the menu permits the teacher to choose the data display of one test (pre, or 
post 1, or post 2), or two tests (pre and post 1, or pre and post 2, or post 1 and post 2), or three 
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tests together (pre, postl, and post2). As with the other elements of the user interface, this menu 
is dynamic is that it changes depending on the actual test data. For example, if students take the 
same test more then three times, there will be more combinations. For example, if there are four 
tests (one pre test and three post tests), then there will be 14 different data graph choices 
5 including: pre, post 1, post 2, post 3, pre & post 1, pre & post 2, pre & post 3, post 1 & post 2, 
post 1 & post 3, post 2 & post 3, pre & post 1 & post 2, pre & post 1 and post 3, pre & post 2 & 
post 3, pre & post 1 & post 2 & post 3. Using this data view module, a teacher or administrator 
can view any test data in the system in various different formats, etc. Since the data view module 
is dynamic and tracks the information in the system, it is able to provide the user with constantly 

□ 

dp updated information. - 

M= The user interface may further permit the user to select a data report print choice. In a 

preferred embodiment, there may be three different print choices. The first print choice is a 
3 "Print All" choice in which reports for all the students or subtests of the graph or table on the 

screen are printed. A second print choice is the "Print Current Student/Subtest" choice in which 
ft the report for the student/subtest currently on the screen is printed. The third print choice is a 
V "Print . . ." choice in which the user is allowed to select the reports for certain student or subtest 
5 that the user would like to print out of the graph or table on the screen. 

While the foregoing has been with reference to a particular embodiment of the invention, 
it will be appreciated by those skilled in the art that changes in this embodiment may be made 
20 without departing from the principles and spirit of the invention, the scope of which is defined by 
the appended claims. 
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